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" The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

• Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- tf the period for reply specified above is less than thirty (30) days, a reply within ttie statutory minimum of thirty (30) days will be considered timely. 

- tf NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this conmnunication. 

- Failure to reply wittiin the set or extended period for reply will, by statute, cause the application to become /^ANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b), 

Status 

1 )|3 Responsive to conrimunication(s) filed on 03/26/2004 . 
2a)l3 This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1, 453 O.G. 213. 

Disposition of Claims 

4) M Claim(s) 4-10 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) S Claim(s) 4-10 is/are rejected. 

7) 13 Claim(s) 4-10 is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing{s) filed on is/are: a)D accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the coirection is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomri PTO-152. 

Priority under 35 U.S.C. § 119 

12)13 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (0- 
a)n All b)n Some * cM None of: 

1 .13 Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) M Notice of References Cited (PTO-892) 

2) n Notice of Draflsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date . 



4) n interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) O Notice of Informal Patent Application (PTO-152) 

6) □ Other: . 



U.S. Patent and Trademark Office 

PTOL-326 (Rev. 1-04) 
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DETAILED ACTION 

1(a). This action was previously mailed on May 19* 2004 to an incorrect address. This action is being remailed 
and the shortened statutory period of 3 months will begin from the mailing date of the action. 

1 . The claim amaidments and substitute specification received on March 26, 2004 (paper numbers 4 and 5, 
respectively) have been placed in the file and were considered by the examiner. An action on the merits follows. 

Priority 

2. Acknowledgment is made of applicant's claim for foreign priority based on an application filed in Japan on 
February 1, 2000. It is noted, however, that applicant has not filed a certified copy of the Japanese application as 
required by 35 U.S.C. 119(b). 

Applicant *s Amendments 

3. The apphcant's specification as originally filed was objected to under 35 USC 1 12 in the previous action as 
being non-compliant with the requirement that a specification be written in "fiiU, clear, concise, and exact terms". 

The applicant has replaced the originally filed specification with a substitute specification in order to 
resolve the prior objection. The applicant has enclosed both a clean version and a marked-up version of the 
substitute specification. 

The examiner is persuaded that the substitute specification is in compliance with the requirements of 35 
USC 1 12 and ho-eby withdraws the original objection to the specification. 

4. The apphcant's claims (1-3) as originally filed were rejected in the previous action undo- 35 USC 103 as 
being unpatentable over Throup (USPN 6,292,167) in view of Aoyama (USPN 6.480,300). 

The applicant has cancelled the originally filed claims 1-3 and added new claims 4-10. It stands that the 
arguments with respect to the originally filed claims are now roidered moot in view of the new set of claims. The 
new claims have been fully consida-ed by the examiner and an action on the merits of these claims follows. 

Claim Objections 

5. The follow quotations of 37 CFR § 1 .75(a) and (d)(1) provide the basis of objection: 

(a) The speciGcation must conclude with a claim particularly pointing out 

and distinctly claiming the subject matter which the applicant regards as his invention or discovery. 
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(d)(1) The claim or claims must conform to the invention as set forth in the remainder of the specification and the terms 
and phrases used in the claims must find clear support or antecedent basis in the description so that the meaning of the 
terms in the claims may be ascertainable by reference to the description. (See § 1 .58(a)). 

6. Claims 4-1 0 are objected to under 37 CFR § 1.75(a) and (d)(1) as failing to particularly point out and 
distinctly claim the subject matter which the applicant regards as his invention or discovery, and failing to conform 
to the invention as set forth in the remainder of the specification. 

With regard to claim 4, the phrase 'allocating said light data to pixels surrounded by an aperture', is 
indistinct and unclear in view of the specification. The specification refers to the process of spreading light into the 
shape of an aperture (paragraph [0008]) and then lata" describes this process by reciting that ligjit data is spread 
'over surrounding pixels according to the shape of a given aperture' (paragraph [0014]). The specification further 
describes this process with reference to Figure 3 in paragraph [0019] where it is stated that 'the amount of light is 
spread to surrounding pixels'. 

The specification makes no moition of allocating fi^t data to pixels. In fact, the only instances in w^ich 
any form of the word 'allocate' are used in the specification are in specific reference to the allocation of memory 
(i.e. paragraph [0022]). 

Additionally, the specification makes no mention of 'pixels surrounded by an aperture' as recited in the 
claim. Paragraph [0019] of the specification clearly explains that the value of a pixel is 'spread to the surrounding 
pixels within the area whose shape is determined from a shape of a given apertine'. The language used in this 
explanation is much clearer and considffably less awkward than the language recited in the claim. 

With regard to claims 7-10, all of these claims contain similar unclear language and it follows that the 
above arguments with respect to claim 4 also apply to claims 7-10. 

Claims 5 and 6 depend on claim 4 and are consequently objected to for the above reasons. 

For examination purposes, the phrase 'allocating said Ught data to pixels surrounded by an aperture which 
has a predetermined shape' (or any similar modifcation of this phrase) will be interpreted to mean that the fight data 
of a pixel is spread to its surrounding pixels, and the area with which it is spread is determined from the shape of an 
aperture. 

Claim Rejections - 35 USC§ 101 

7. 35 US.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, 
or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

8. Claims 9 and 10 are rejected under 35 U.S.C. 101 as being directed to non-statutory subject matter. As 
currently written, these claims recite purely fiinctional descriptive material, which is non-statutory per se. This 
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problem could be easily remedied by amending the preamble of the claims to recite "A computer program, stored on 
a computer readable medium, comprising:" 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

10. Claims 4-6 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over Throup (USPN 6,292, 167) 
in viewof Aoyama (USPN 6,480,300). 

With regard to claim 4, Throup discloses a method of creating a defocused image from an input image 
(Throup col. 8 lines 29-31). 

Throup discloses the claimed step (a) of receiving an input image including a plurality of pixel data 
(Throup col. 8 lines 32-33 with Figure 3). 

Throup further discloses the claimed step (b) of selecting a pixel from the image (Throup col. 8 lines 41- 

43). 

Throup further discloses the claimed step (d) of spreading the pixel to data to its surrounding pixels 
(Throup col. 8 lines 41-45). Throup discloses that the area that the pixel data is spread is detamined from the shape 
of an aperture (Throup col. 8 lines 61-64). Throup also discloses that spreading the pixel data over this area creates 
a defocused disk image in which all the pixels values of the disk are substantially equal to each other, and the total 
intaisity of the disk is equal to the original pixel data which was spread (Throup col. 8 lines 48-53 with Figure 5). 
Throup discloses that the coefficients have values between 0 and 1, and the sum of the coefficients is 1 . It follows 
that the coefficients that make up the array shown in Figure 5 of Throup (which is analogous to the claimed apature 
determined area of pixels recited in the claim) are all equal to each other. In this particular example, the coefficients 
are equal to 1/25 (0.04). It follows that the sum of pixel value P22 multiplied with all of the array coefficients is 
indeed equal to the pixel value itself 

Throup further discloses repeating steps (b) and (d) for all pixel data included in the input image to create a 
defocused image (Throup col. 8 lines 45-48). 

With regard to the claimed step (c) of converting the selected pixel data from a predetermined scale to a 
linear scale to geno-ate light data, Throup discloses a gamma factor defining the relationship between the pixel data 
and the corresponding li^t data, but fails to expressly disclose a logarithmic conversion between these two scales. 
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Aoyama, however, discloses the covnersion of the logarithmic digital data of the original image to a linear 
scale of data in order to generate lig^it data having some light amount (Aoyama coL 3 lines 10-20), before 
performing a defocusing processing (Aoyama col. 3 lines 46-52). 

It would have been obvious to one reasonably skilled in the art at the time of the invention to modify 
Throup's defocusing method by inserting the step of converting logarithmic pixel data to a linear scale before 
defocusing as taught by Aoyama. Such a modification would have allowed for the defocusing method of Throup to 
be performed on linear luminance data rather than logarithmic pixel data. This would have made for an electronic 
defocusing system that could more accurately represent the defocusing of an actual camera (Aoyama col. 3 lines 29- 
39). 

With regard to claim 9, a computer-readable recording medium that stores a program which causes the 
computer to execute the steps of a method is essential if the image processing method disclosed in the combination 
of Throup and Aoyama is to function. Tho-efore, a computer-readable recording medium is inherent in these 
teachings. 

With regard to claim 5, Aoyama fUrtha* discloses converting the scale of the image back to the 
predetamined logarithmic scale aflo" defocusing processing (Aoyama col. 3 lines 53-55). 

With regard to claim 6, the combination of Throup and Aoyama discloses receiving an input image and 
converting the image into a linear scale before processing the image. The combination further discloses that this 
input data can be in a number of different formats (Throup col. 6 lines 39-47). M view of the aforesaid combination, 
it would have been obvious to one reasonably skilled in the art at the time of the invention to check the input image 
in order to see if it that image data format was already represented in a linear scale before performing a linear scale 
conversion process on the image. Such a modification would have allowed for a system that avoided redimdancy 
conversions and provided for a more efficient image defocusing method. 



11. Claims 7, 8 and 10 are rejected undo* 35 U.S.C. 103(a) as being unpataitable over the combination of 
Throup and Aoyama as applied to claim 4 above, and further in view of Potmesil et al. ("A Lens and Apoture 
Camera Model for Synthetic Image Generation"). The arguments as to the relevance of Throup and Aoyama as 
applied above are incorporated herein. 

With regard to claim 7, the aforesaid combination fails to expressly disclose the furthCT limitation of 
determining the size of the defocused disk image based upon the pixel distance information. Potmesil, however, 
teaches determining the size of a defocused disk on the basis of pixel distance information (Potmesil pg. 299 right 
column with reference to Figure 5). The circle of confusion disclosed in Potmesil is analogous to the defocused disk 
recited in the claim. It would have been obvious to one reasonably skilled in the art at the time of the invention to 
modify Throup and Aoyama's image defocusing method by determining the size of a defocused disk on the basis of 
pixel distance information as tau^t by Potmesil. Such a modification would have allowed for a system in which the 
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amount of defocusing was proportion to the pixel distance information and consequently would have made for a 
system which generated more realistic looking images (Potmesil pg. 297 right column paragraph). 

With regard to claim 8, all of the limitations of the claim have been addressed in the above argument with 
respect to claim 7. 

With regard to claim 10, a computer-readable recording medium that stores a program which causes the 
computer to execute the steps of a method is essential if the image processing method disclosed in the combination 
of Throup, Aoyama and Potmesil is to function. Therefore, a computer-readable recording medium is inherent in 
these teachings. 



Conclusion 

12. Applicant's amendment necessitated the new ground(s) of rejection presented in this OfBce action. 
Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension 
of time policy as set forth in 37 CFR 1 . 1 36(a). 

A shortaied statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing dale of this final 
action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, 
then the shortaied statutory period will expire on the date the advisory action is mailed, and any extension fee 
pursuant to 37 CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, however, 
will the statutory period for reply expire later than SIX MONTHS from the date of this final action. 



1 3. Any inquiry concerning this communication or earlier communications from the examina should be 
directed to Patrick L Edwards whose telephone number is (703) 305-6301. The examina can normally be reached 
on 8:30am - 5:00pm M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Leo Boudreau 
can be reached on (703) 305-4706. The fax phone number for the organization where this application or proceeding 
is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent Application Information 
Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR 
or Public PAIR. Status information for unpublished applications is available throup Private PAIR only. For more 
information about the PAIR system, see http://pair-direcl.uspto.gov. Should you have questions on access to the 
Private PAIR system, contact the Electronic Business Center (EEC) at 866-217-9197 (toll-free). 



Patrick Lynn Edwards 
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